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Abstract 

In statistics, experimental designs are methods for making efficient exper- 
iments. E-optimal designs are the multisets of experimental conditions which 
minimize the maximum axis of the confidence ellipsoid of estimators. The aim 
of this thesis is to propose a new algorithm for constructing E-optimal designs 
approximately for weighted polynomial regression with a nonnegative weight 
function. 

First, an algorithm to calculate E-optimal designs for weighted polynomial 
regression of particular weight functions is discussed. Next a new algorithm 
for constructing E-optimal designs approximately is proposed. Notions of the 
Tchebycheff systems and orthogonal polynomials are used in the proposed al- 
gorithm. Finally in this thesis, the results of numerical examples are shown in 
order to verify the accuracy of the E-optimal designs computed by the proposed 
algorithm. 
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1 Introduction 



In statistics, experimental designs are methods for making efficient experiments 
Experimental designs are needed especially for experimenters. At first, in 1920s, 
Fisher 1 8 1 considered a formal mathematical methodology for designing exper- 
iments. This is the beginning of experimental designs. We can make efficient 
experiments by analyzing a relationship between experimental conditions and 
the accuracy of estimators. In experimental designs, optimal designs are mul- 
tisets of experimental conditions which give us the highest accuracy estima- 
tors based on a particular optimality criterion. On different demands of ex- 
perimenters, several optimal criteria and optimal designs EEJEJCEUIU are use d- 
One of the optimal criteria is the E-optimality criterion, which was introduced 
by Ehrenfeld |6|. The best designs according to the E-optimality criterion are 
called E-optimal designs. E-optimal designs minimize the maximum axis of 
the confidence ellipsoid of estimators, namely, E-optimal designs minimize the 
maximum eigenvalue of the covariance matrix of estimators. E-optimal designs 
have been investigated by numerous authors in the literature (TJ [3l [5j [TT) . E- 
optimal designs for only particular regression have been obtained exactly. 

In this thesis, we discuss how to calculate E-optimal designs for weighted 
polynomial regression. Weighted polynomial regression means polynomial re- 
gression with non- constant variance \7\. Optimal designs for weighted polyno- 
mial regression have been studied by many authors l3ll4l[T5l . 

One of the approaches for obtaining E-optimal designs is to use the Tcheby- 
cheff systems. One of the characteristics of the Tchebycheff systems is that 
there is a linear combination of their basis functions which satisfies some prop- 
erties. This linear combination is called the Tchebycheff function in this thesis. 
The Tchebycheff systems play an important role in several domains of mathe- 
matics (9j[[0). For example, it is used for the theory of approximations, meth- 
ods of interpolation, generalized moment problems, numerical analysis, oscil- 
lation properties of eigenfunctions of the Sturm-Liouviile problems, general- 
ized convexity, the theory of inequalities, and optimal designs. E-optimal de- 
signs for polynomial regression and particular weighted polynomial regression 
were studied with the Tchebycheff systems (3l[T3] . If Tchebycheff functions of 
the basis functions of the linear regression are known, then the corresponding 
E-optimal designs for general weighted polynomial regression can be calcu- 
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lated HU . However, it is not trivial how to obtain Tchebycheff functions from 
the Tchebycheff systems. 

Orthogonal polynomial sequences are families of polynomials such that the 
inner products of any distinct two polynomials in the sequences are zero. Or- 
thogonal polynomial sequences are also useful tools in many fields of mathe- 
matics |2l[T2j[T6l . For example, it is used for the theory of approximations, and 
mathematical physics including integrable systems. 

In this thesis, we propose a new algorithm for constructing E-optimal de- 
signs approximately for weighted polynomial regression with general nonneg- 
ative weight functions by using the Tchebycheff systems and orthogonal poly- 
nomials. Moreover, we verify the accuracy of this algorithm by numerical ex- 
amples. 

Section [2] contains some preliminaries of optimal designs and the Tcheby- 
cheff systems. Section |3] contains some preliminaries of orthogonal polynomi- 
als and the Gram-Schmidt orthogonalization. In Section|4]we present an algo- 
rithm for constructing E-optimal designs approximately for weighted polyno- 
mial regression with general weight functions. Section [5] describes the results 
of numerical examples. Section[6]is devoted to conclusions. 

2 Preliminaries of Experimental Designs 

2. 1 Linear Regression and Estimators 

A linear regression model is defined by 

Y = 6 T f(x) + e 



[6 ,6i,--- ,9 m -i) 



fi(x) 
,/m-iW 



+ e (2.1) 



where fix) = (/o(x),/i(x),...,/ m _i(x)) T is a known vector of real-valued lin- 
early independent continuous functions, = [do,di,. . .,6 m -i) T is an unknown 
parameter vector, and £ is a random error term. The functions fo{x),f\ (x), . . . , 
f m -i{x) are called basis functions. 
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The linear regression model 1 12.11 1 means that Y is the response of an ob- 
servation at an experimental condition x. The purpose in an experiment is to 
estimate the parameter vector 9. Here, we assume that all possible points where 
observations can be made are on the closed finite interval X = [a, b] c U. 

Let us assume that we can make N observations 

y i = 9 T f(x i ) + e i , i = l,2,...,N 

under the experimental conditions jci, x 2 , . . . , X/v e 90. Throughout this thesis, 
we assume that the expectation of an error ei is zero and different errors are 
uncorrelated. Conventionally we sometimes assume that the variance of an 
error is a positive constant. That is, 

E[e f ]=0, E[EiEj] = 0, V[Ei]=a 2 >0, i,j = l,2,...,N, ijij. (2.2) 

The best linear unbiased estimator {BLUE) 9 of the parameter vector 9 is defined 
as the estimator which satisfies the following three conditions: 

(a) The estimator 9 is described as a linear combination of the responses, 
namely 6 = Ly, where L is an m x N matrix. 

(b) The expectation of the estimator 9 is equal to 9, namely E [0] = 9. 

(c) For an arbitrary estimator 9 which satisfies the conditions ® and (EJ, 
Cov[0] - Cov[0] is nonnegative definite, where Cov[9] denotes the co- 
variance matrix of 9. 

The following theorem is well known in statistics. 

Theorem 2.1 (Gauss-Markov's Theorem). Under the conditions 1 12.21 1 and 
det(X T X) ^ 0, the BLUE 9 of the parameter vector 9 is given by 

9 = (X T X)' 1 X T y, (2.3) 

where X = (/(xi), /(x 2 ), . . . , /(Xjv)) T is an Nx m matrix, andy = (yi, 3/2, . . . , vat) 7 . 
The covariance matrix of the BLUE 9 is given by 

Cov[9] =a 2 {X T X)~ l . 
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2.2 Optimal Designs and Fisher Information Matrix 

A design jl is a multiset of experimental conditions Xi, x 2 , . . . , Xn £ 3C. When we 
make experiments, we should choose the optimal multiset p* . But in general, 
it is difficult to calculate the optimal multiset jl* . 

Then, in this thesis we consider a multiset jl as a probability measure p. Let 
SPgc denote the set of all probability measures on the Borel sets of the interval 
SC. For given p e let p{x) denote the cumulative distribution function, and 
let Prob^x) denote the probability mass function 

Prob^(x) = lim [p{x + 8) - /i(x- 5)) . 

We consider the probability measure whose the probability mass function is 
given by 

^ #{ie{l,2,...,N}|jc / = Jc} 

Prob„(x) = ■ , 

M N 

where #S denotes the number of elements in the set S. Assume that the distinct 
points among xi, x 2 , . . . , x N are the points Xi, x 2 , . . . , x n , n< N. Thus we also call 
the probability measure \i the design, namely, the design y. means that we make 
Npi experiments under a condition x;, i = 1,2,..., n, where 

Pi = Prob^Cxi), i = l,2,...,n. 

We sometimes write the design [i as 

(2.4) 



( X\ x 2 



Pi 92 



For a fixed sample size N, let us consider the case where the numbers Np it 
i = 1,2,..., n are not necessary to be integers. That is, pt, i = 1,2, n must be 
arbitrary nonnegative numbers such that £" =1 pi = 1. In practice, the numbers 
Npi, i = 1,2, .... n of the design )U are sometimes rounded to be integers in or- 
der to consider the corresponding multiset jl. Thus, hereinafter the design /i 
denotes only a probability measure, not a multiset. 

We should choose a good design, since the BLUE 1 12.31 1 depends on the de- 
sign p. In general, if the covariance matrix of the BLUE is "small" in some 
sense, the BLUE 6 becomes a highly accurate estimator. Here, in order to de- 
fine what means that the covariance matrix is small, let us consider the Fisher 
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information matrix. The Fisher information matrix of the design p is defined 
by the Gram matrix 

M{p) = [ f(x)f T ix)dp(x) (2.5) 

JSC 

= E/te)/ T te)p/ 

i=l 

' LUfoMMxAPi ••• E"=i/o(*i)/m-ita)Pi ' 

X n i=ifm-\{Xi)f Q {Xi)pi ... Ei = ifm-l(Xi)fm-l(Xi)Pij 
By Theorem l2.ll the covariance matrix of the BLUE 6 is represented as 

Cov[6] = ^-M~ x ip). (2.6) 

In order to make the covariance matrix of the BLUE the smallest in some 
sense, we should choose the optimal design p whose Fisher information matrix 
M{p) takes the "smallest form". Here, let us consider the <& p -optimality crite- 
rion, a commonly used optimality criterion in experimental designs, that is 



(I - \p 
Minimize 0„ (u) = — trM p (u) , < p < oo 
m \m ) 

subject to peSPx. 



(2.7) 



Especially, when p — >■ oo, p — >■ 0, p = 1, the objective function O p (/i) is repre- 
sented as 

1 

Ooo(ju) = max — — , 
l<i<mA/(jUJ 

$ (p) = (detM(ju))™, 

= — trM -1 in), 
m 

respectively, where X\ ip), A 2 (//),..., A OT (/x) denote the eigenvalues of the Fisher 
information matrix Mip) of the design p. The design p which minimizes ip) 
is called an E-optimal design. Similarly, the design p which minimizes O (/i) is 
called a D-optimal design, and the design p which minimizes <2>x ip) is called an 
A-optimal design. That is, the E-optimal designs are the optimal solutions of 
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the optimization problem 
Maximize A m i n (M(/i)) 

(2.8) 

subject to fj,€.2?%;, 

where A m i n (M(/i)) denotes the minimum eigenvalue of the Fisher information 
matrix M(/i). The D-optimal designs are the optimal solutions of the optimiza- 
tion problem 

Maximize detM(/i) 

(2.9) 

Subject tO IJLZ-SPgc, 

and the A-optimal designs are the optimal solutions of the optimization prob- 
lem 

Minimize tr M _1 ()u) 

^ (2.10) 
subject to ij, €.3?%;. 

When the error e is normally distributed, the confidence ellipsoid for the BLUE 
6 with an arbitrary fixed confidence level is defined by 

\e\{d-d) T M- l {ii){d-d)<cY (2.11) 

where c is a constant depending only on the confidence level. In this case E- 
, D-, and A-optimal designs can be interpreted geometrically in terms of the 
confidence ellipsoid. E-optimal designs minimize the size of the major axis of 
the confidence ellipsoid, D-optimal designs minimize the volume of the con- 
fidence ellipsoid, and A-optimal designs minimize the dimension of the diag- 
onal of the enclosing box around the confidence ellipsoid respectively. These 
characteristics are shown by Figures l2TTl 12.21 and !2.3l . 
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Minimize 




01 

Figure 2.3: The characteristics of A-optimal designs 
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In this thesis, we discuss the problem of calculating E-optimal designs for 
the linear regression on 3C = [-1, 1]. 



Problem 2.2 (The problem of calculating E-optimal designs). We consider the 
linear regression 12.lt . The E-optimal designs are the optimal solutions of the 
optimization problem 

Maximize A min (M(ju)) 

Subject to )U 

where p is a design, M{p) is a Fisher information matrix for the regression 
model defined by J2.5L and 2?\-\,\\ is the set of all probability measures on 
[-1,1]. 



We note that E-optimal designs do not depend on the sample size N. 

2.3 Tchebycheff Systems and Their Applications to Optimal De- 
signs 

Let u\, Uz, . . . , u n : I — U denote linearly independent continuous functions de- 
fined on a closed finite interval J = [a, b]. If the determinant 



Ui(ti) Ui{t 2 ) ••• Ui{t n ) 

u 2 ih) u 2 {t 2 ) ••• u 2 {t n ) 

U n {h) U n [t 2 ) ••• U n {t n ) 



(2.12) 



is always positive or always negative whenever the parameters are chosen as 
a < t± < t 2 < ■■■ < t n < b, the set {u\,u 2 ,...,u n \ is called the Tchebycheff sys- 
tem on L If the determinant H2.12H is always nonnegative or always nonpositive 
whenever the parameters are chosen as a < t\ < t 2 < ■ ■ ■ < t n < b, then the set 
{u\, u 2 , ... , u n } of the functions is called the weak Tchebycheff system on I. It is 
well known 1 10, Theorem II 10.2] that if the set {u\, u 2 ,..., u n } is a weak Tcheby- 
cheff system, then there exists a unique function K(f) given by 

K{t)=j T u{t), y = [r i, 72, ■■■,Tn) T eR", u{t) = {ui,u 2 ,...,u n ) T 

which satisfies the following properties: 

(a) |K(f)|<lforallfeJ, 
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(b) There exist n points S\,s 2 ,...,s n chosen as a < S\ < s 2 < ■ ■ ■ < s n < b such 
that jc(Sj-) = [-If, i = 1,2,..., n. 

The function k(?) is called the Tchebycheff function, and the points s±, s 2 , ■ ■ ■ , s n 
are called the Tchebycheff points. 

Example 2.3 (Examples of Tchebycheff systems). In each of the following cases, 
the set {ui, u 2 ,...,u n } is a Tchebycheff system 1 10 , pp. 9-20]. 

(a) The set of power functions Uj{t) = h{t)t l , i = 1,2,..., n is a Tchebycheff 
system where h(t) is a positive continuous function on /. If h{t) is a non- 
negative continuous function on /, then the set {u\, u 2 , . . . , u n } is a weak 
Tchebycheff system. 

(b) The set of eigenfunctions of the Sturm-Liouville operator 



is a Tchebycheff system where pit) is a continuous positive function on 
I, and q{t) is a continuous function on /. 

There are some relations between the Tchebycheff systems and optimal de- 
signs. The following theorem indicates the way to obtain E-optimal designs by 
using the Tchebycheff systems HU pp. 94-97]. 

Theorem 2.4 (Tchebycheff designs). Suppose the set {fa{x),fi (x), . . . , f m -\ (x)} 
of the basis functions of the linear regression J2.H is a Tchebycheff system and 
generates a Tchebycheff function jc(jc) given by 

K(x) = r T fix), yeR", xe3£. 

Also suppose that si,s 2 ,...,s n are Tchebycheff points of the Tchebycheff function 
k (x) . If Tchebycheff points of the system are determined uniquely, then the design 
p* given by 



is called the Tchebycheff design. The Tchebycheff design p* is the E-optimal de- 
sign if the linear regression Il2.lt has a unique E-optimal design. 





£,7=1,2,..,, m 
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2.4 Optimal Designs for Some Regression Models 
2.4. 1 Optimal Designs for Polynomial Regression 

Let us consider the linear regression model II2.1L In the case where /(x) is given 

by 



the linear regression model 

m-l 

y= £ 0jJC f + £ (2.13) 
i=0 

is called a polynomial regression model. Let us take N observations 

m-l 

yk= LOixi + et, k=l,2,...,N (2.14) 

under the experimental conditions Xi, X2, . . ., Xjv e 9£. Several researches show 
how to compute optimal designs for polynomial regression. For example, D- 
optimal designs for polynomial regression can be calculated by using canonical 
moments 1 5 1 . E-optimal designs for polynomial regression can be calculated by 
using the Tchebycheff systems |3] . 

2.4.2 Optimal Designs for Weighted Polynomial Regression 

Let us consider the polynomial regression model D2.14I I without the assumption 
that the variance of an error is constant. Namely, we assume that 



where a>{x) is a nonnegative function, called a weight function of regression, 
which depends on an experimental condition x. The Fisher information matrix 
of a design /i for weighted polynomial regression is redefined as 



/(x) = (/ (x),/i(x),...,/ m _ 1 (x)) T = (l,x,...,x m - 1 ) T , 



E[e,-] = 0, E[e i e / ] = > V[e f ] = 




>0, i,j = 1,2,..., AT, 



(2.15) 
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Then, E-, D-, and A-optimal designs are denned by the same ways 1 12.81 1, 1 12.91 1, 
and ( 12. lOt respectively, as the polynomial regression model. 

E-optimal designs for weighted polynomial regression can be calculated ex- 
actly for only particular weight functions. These are described later in Subsec- 
tionOl 

3 Preliminaries of Orthogonal Polynomials 

In this section we discuss orthogonal polynomials and the Gram-Schmidt or- 
thogonalization. The Gram-Schmidt orthogonalization is a method for making 
an orthogonal polynomial sequence l2l fT2l[T6l . 

3.1 Inner Product, Moments, and Classical Orthogonal Poly- 
nomials 

At first, we define the inner product (•, •> with respect to a nonnegative function 
r](x) by 



where p, q are polynomials defined on [a, b] . The function r\{x) is called a weight 
function of orthogonal polynomials. 
If polynomials p{x),q{x) satisfy 

(p(x),q{x)) = 0, 

then we say that they are orthogonal. The following functions are examples of 
orthogonal polynomials. They are called the classical orthogonal polynomials. 

(a) Jacobi polynomials /„ (x): 




(3.1) 




(3.2) 
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where £ Z> , and a>-l,j8>-l. The orthogonality relation is given by 



1 j^hxu^hx^^dx 
i 

2 a+ P +1 T{n + a + l)T(n + p + 1) 

7*5 m.n 



{2n + a + p + l)T{n + a + p + 1) n\ 
where the weight function r^'^ (x) is given by 77 j a '^ (x) = (l-x) a (l + x)^. 
(b) Laguerre polynomials (x) : 



L(«) W = _f_^_( JC "+«e- JC ) 



e x d" 
n\x a dx r 
j^(n + a\ i-x) k 

k=0 



[n-kj k\ ' 

where n £ Z> , and a > -1. The orthogonality relation is given by 



nco 

Jo J 



(x)L ( „ a) (x)dx = " ' - 8 m ,n 

o 

where the weight function rj^ (x) is given by (x) = x a e~ x . 
(c) Hermite polynomials H n (x) : 

„ v 2 d" v 2 

ff n (x) = (-l)"e x - — e~ x 
dx n 

" " ! ^ {n-2k)\k\ ' 

where n £ Z> and LfJ denotes the largest integer not exceeding t. The 
orthogonality relation is given by 

/oo 
H m {x)H n {x)r]u (x)dx = 2 n n\\fn5 m ,n 
-OO 

_ 2 

where the weight function t/hM is given by r/nix) = e~ x . 
3.2 Gram-Schmidt Orthogonalization 

The following algorithm, called the Gram-Schmidt orthogonalization, means 
a method for orthogonalizing a set of polynomials in an inner product space. 
Here we consider the inner product space defined by J3.1L 



T{n + a + l) 
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Algorithm 3. 1 (Gram-Schmidt orthogonalization) . We define the projection op- 
erator proj by 

(u, v) 
pr ° UM)= <^T' 

where u, v are polynomials. Then, ifu\, u 2 ,...,u n are linearly independent poly- 
nomials, the following process 



for k = 1,2,..., n : 



k-1 



Vk = a* - £p r °i 



(3.3) 



1=1 



constructs orthogonal polynomials v\,V2,...,v n . 

The result v of the Gram-Schmidt orthogonalization can be expressed by 



(Ux,U\) 
(U 2 ,Ui) 



(Ui,U 2 ) 

(u 2 ,u 2 ) 



(Uk-\,U\) (Uk-i,U 2 ) 
U\ u 2 



(Ui,U\) 
(U 2 ,U\) 



(Ui,U 2 ) 

(u 2 ,u 2 ) 



(Uk-\,U\) (Uk-i,U 2 ) 



(U\,U k ) 

(u 2 ,u k ) 



(U\, Uk-i) 
(U 2 , Ut-i) 

(Uk-l, Uk-i) 



t Jc — 1,2,..., Yl. 



(3.4) 



4 Construction of E-optimal Designs for Weighted 
Polynomial Regression 

Let us consider about the weighted polynomial regression with the weight func- 
tion w{x) of regression. From Example l2.3l lfall, the set 



j\/ w{x),x\/ w[x),...,x m X \J w (x)| 



(4.1) 



is a Tchebycheff system. By Theorem l2.4l if we know the Tchebycheff function 
of the set 114.11 1, we can obtain E-optimal designs for weighted polynomial re- 
gression. However, it is not trivial how to get the Tchebycheff functions. In this 
section, we propose an approximate approach to construct E-optimal designs 
for weighted polynomial regression. 
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4. 1 Construction of E-optimal Designs for Particular Weighted 
Polynomial Regression with Jacobi Polynomials 

In this subsection, we discuss an example that we can compute E-optimal de- 
signs exactly for weighted polynomial regression using the Tchebycheff sys- 
tems. Let us consider weighted polynomial regression in the case where its 
weight function is described by 

w{x) = a-x) a {l + xf, a, /3e{0,l}. (4.2) 

Dette |3| shows how to compute E-optimal designs for these regression as the 
following theorem. 

Theorem 4.1. With the weight function 1 14.21 1, the function 

a-x^'Hl + x)? 12 !^ 12 '^ (4.3) 

is a Tchebycheff function where J^'® denotes a Jacobi polynomial d3.2D . Then, 
the Tchebycheff design p* for weighted polynomial regression with the weight 
function w{x) can be computed by Theorem \ZM The Tchebycheff design p* is 
equal to the E-optimal design. 

Figure I4~T1 shows the graph of 114.31 1 with a = 0, /3 = 1, m = 8. This figure in- 
dicates that the function d4.3D has local maximums and local minimums whose 
absolute values are exactly the same. 

Tables lATTl - IA.4l in Appendix lA. ll give some numerical examples. We can con- 
firm that E-optimal designs for weighted regression with weight functions 1 14.21 1 
can be computed by using Theorem l4.ll 

4.2 Approximate Tchebycheff Functions and An Approach to 
E-optimal Designs for General Weight Functions 

By Theorem l4.1[ if the weight function w (x) of regression is given by 114.211 , then 
the E-optimal designs can be computed. In this subsection, we discuss the 
weighted polynomial regression of general weight functions and approximate 
approach to it. 

In the previous sections, we discuss the exact Tchebycheff designs. We have 
only a few examples that we can obtain the Tchebycheff designs for weighted 
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Figure 4.1: A Tchebycheff function k(x) = /j 1/2 ' 1/2) (x) VT^x 



polynomial regression by the same way as in Subsection l4.1[ In this section we 
discuss a new relaxation of the Tchebycheff function k(x). 



Definition 4.2 (Approximate Tchebycheff functions). Suppose that 
x e [-1,1]. For a general weight function w{x) of regression such that if -I < 
x < 1 then w{x) > 0, the function k\x) obtained by the following steps is called 
an approximate Tchebycheff function. 

(a) Compute v m {x) by the Gram-Schmidt orthogonalization for the weight 
function rj{x) of orthogonal polynomials given by 

w{x) 

T](X) = . , (4.4) 

where u^ix) = x k ~ l , k = 1,2,..., m are usedin Gram-Schmidt orthogonal- 
ization. 

(b) Obtain (x) = v m (x) \/w (x) . 

The Tchebycheff points s\, s\, . . . , s\n of the approximate Tchebycheff function 
k^(x) are defined as local maximum points and local minimum points. 



Remark 4.3 (The difference of two "weight functions"). Note that the weight 
function w(x) of regression and the weight function r\{x) of orthogonal polyno- 
mials are different. When the approximate Tchebycheff functions are consid- 
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ered, The relationship between w(x) and rj{x) is denoted by H4.4I I. 



The exact Tchebycheff function k(x) has local maximums and local mini- 
mums whose absolute values are exactly the same. In contrast, the approximate 
Tchebycheff function jc^x) has local maximums and local minimums on [-1, 1] 
whose absolute values are almost the same. Figures l4~2l shows an example of the 
approximate Tchebycheff functions. This figure indicates that an approximate 
Tchebycheff function k^{x) has local maximums and local minimums whose 
absolute values are almost the same but not necessary to be exactly the same. 



Figure 4.2: The approximate Tchebycheff function k' (x) of Definition S2J m = 

12, w(x) = (l-x) 1 (3/2 + x) 1/2 

By using Definition l4.2[ the proposed algorithm for calculating the approx- 
imation of E-optimal designs for weighted polynomial regression is described 
as follows. 

Algorithm 4.4 (The algorithm for constructing the approximate Tchebycheff 
designs). For a general weight function w(x) of regression such that if -I < x < 
1 then w{x) > 0, the design p) for weighted polynomial regression computed by 
the following steps is called the approximate Tchebycheff design. 

(a) Compute the approximate Tchebycheff function (x) by the Definition \4.2[ 

(b) Compute Tchebycheff points s\, s^, . . . , s^ of the approximate Tchebycheff 
function k^{x), 




x 
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i,j-\,2,...,m 



where y = (71 , 72, • • • , Jm) denotes the vector of the coefficients of the ap- 
proximate Tchebycheff function jc' (x). 



Remark 4.5 (The approximate Tchebycheff functions on SC = [a, b]). We can 
also consider the approximate Tchebycheff designs on SC = [a, b] by the similar 
way. In order to calculate the approximate Tchebycheff functions for weighted 
polynomial regression on X = [a,b] instead of 3C = [-1,1], the relationship 
between w{x) andr^(x) 



In the next section, we show some results of numerical examples in order to 
verify that approximate Tchebycheff designs are close to E-optimal designs. 

5 Numerical Examples 

In the previous section, we discuss Algorithm l4.41 the algorithm for construct- 
ing the approximate Tchebycheff designs for weighted polynomial regression. 
In this section, we verify the accuracy of this algorithm with some numerical 
examples. 

Tables [57TI45 .61 give numerical examples for Algorithm l4.4[ The first column 
contains the degrees m of regression. The second column contains the graphs 
of the approximate Tchebycheff functions k^x). The third column contains 
the experimental conditions x\,X2,...,x m and p\,p2,...,p m of the approximate 
Tchebycheff designs written as 



T]{x) = 



w{x) 



\J{x- a){b-x) 



is used. 



X\ X2 
,Pl P2 



Pm 



X 



m 



) 
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The fourth column contains the minimum eigenvalues A m i n (M(/i)) of the Fisher 
information matrices. The last column contains 1 - eff^(/i), where eff^(ju) de- 
notes E-efficiency of a design /i defined by 



sup Amin(M(jU)) 



Note that the E-efficiency eff|^(/i) e [0, 1]. The E-efficiency eff^ indicates that 
the larger the E-efficiency eff^(jU) is, the better the design /i is in terms of the 
E-optimality criterion. In order to compute the E-efficiency eff^(//), it is neces- 
sary to compute the E-optimal designs. If w{x) = (1 - x) a {l + x)P, a,/3 e {0, 1}, 
then the design is calculated by Theorem l4.ll Otherwise, the design calculated 
by the random optimization operated for a long time is used instead of the E- 
optimal designs. The computation is executed on the software Maple 15. 

Tables I5TT145 .61 indicate that the E-efficiency eff^(/i) is close to 1 regardless 
of the weight function w{x). This verifies the accuracy of Algorithm l4.41 More- 
over, if the weight function w{x) coincides 14.21 . the E-efficiency eff^ (//) is ex- 
actly equal to 1. This means that Algorithm l4.4l computes the E-optimal designs 
exactly for weighted polynomial regression with the weight function w(x) = 
(l-x) a (l + x)^, a, fie {0,1}. 
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Table 5.1: Approximate Tchebycheff designs for weighted polynomial regres- 
sion with w{x) = (l-x) 1/2 (2 + x) 1/2 



m graph of K t (x) appr. Tchebycheff design A min (M(p)) 1 - eff^, (p) 



X! = -1.000, p! =0.1721 
x 2 = -0.1252, p 2 = 0.4896 
x 3 = 0.9215, p 3 = 0.3383 



7.693 x 10 -3 



8.720 x 10" 5 



10 




xi = -1.000, pi = 
x 2 = -0.9407, p 2 
x 3 = -0.7710, p 3 
x 4 = -0.5126, p 4 
x 5 = -0.1969, p 5 
x 6 = 0.1396, p6 = 
x 7 = 0.4592, p 7 = 
x 8 = 0.7269, p 8 = 
x 9 = 0.9118, p 9 = 
xio = 0.9949, pio 



0.03909 
= 0.08305 
= 0.09785 
= 0.1201 
= 0.1395 
0.1423 
0.1261 
0.1031 
0.08509 
= 0.06379 



1.714 x 10" 6 



3.334 x 10 -5 



Table 5.2: Approximate Tchebycheff designs for weighted polynomial regres- 
s ion with w{x) = e x 

m graph of K t (x) appr. Tchebycheff design A m i n (M(p)) 1 - eff^ (p) 



xi = -1.000, pi =0.3204 
x 2 = 0.2405, p 2 = 0.5360 
x 3 = 1.000, p 3 = 0.1436 



1.976 x 10" 



4.082 x 10" 



10 



Xi = -1.000, pi = 
x 2 = -0.9326, p 2 
x 3 = -0.7416, p 3 
x 4 = -0.4566, p 4 
x 5 = -0.1190, p 5 
x 6 = 0.2267, p 6 = 
x 7 = 0.5399, p 7 = 
x 8 = 0.7876, ps = 
x 9 = 0.9457, p 9 = 
Xio = 1.000, pio = 



0.04351 
= 0.09338 
= 0.1119 
= 0.1360 
= 0.1494 
0.1404 
0.1164 
0.09315 
0.07880 

0.03710 



1.660 x 10" 6 



2.998 x 10" 9 
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Table 5.3: Approximate Tchebycheff designs for weighted polynomial regres- 
sion with w(x) = 1 



m graph of k^Ix) appr. Tchebycheff design A m i n (M(p)) l-eff^(p) 




xi = -1.000, pi =0.2000 
x 2 = 0.000, p 2 = 0.6000 
x 3 = 1.000, p 3 = 0.2000 



4.000 x 10" 



0.000 



10 




xi = -1.000, pi = 
x 2 = -0.9397, p 2 
x 3 = -0.7660, p 3 
x 4 = -0.5000, p 4 
x 5 = -0.1736, p 5 
x 6 = 0.1736, p6 = 
x 7 = 0.5000, p 7 = 
x 8 = 0.7660, ps = 
x 9 = 0.9397, p 9 = 
Xio = 1.000, pio = 



0.04011 
= 0.08563 
= 0.1020 
= 0.1263 
= 0.1460 
0.1460 
0.1263 
0.1020 
0.08563 

0.04011 



1.671 x 10" 6 



0.000 



Table 5.4: Approximate Tchebycheff designs for weighted polynomial regres- 
sion with w{x) = 1 - x 



m graph of k^(x) appr. Tchebycheff design A m i n (M(p)) l-eff^(p) 



xi = -1.000, pi = 0.1238 
x 2 = -0.3090, p 2 = 0.3955 
x 3 = 0.8090, p 3 = 0.4807 



9.524 x 10" 2 



0.000 



10 




Xi = -1.000, pi = 
x 2 = -0.9458, p 2 
x 3 = -0.7891, p 3 
x 4 = -0.5469, p 4 
x 5 = -0.2455, p 5 
x 6 = 0.08258, p 6 : 
x 7 = 0.4017, p 7 = 
x 8 = 0.6773, ps = 
x 9 = 0.8795, p 9 = 
xio = 0.9864, pio 



0.03642 
= 0.07706 
= 0.09006 
= 0.1108 
= 0.1321 
= 0.1410 
0.1311 
0.1099 
0.09082 
= 0.08071 



9.463 x 10" 7 



0.000 
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Table 5.5: Approximate Tchebycheff designs for weighted polynomial regres- 
sion with w(x) = 1 + x 



graph of k^x) 



m 



appr. Tchebycheff design 



A min (M(p)) 



l-ef^(M) 




Xi = -0.8090, pi = 0.4807 
x 2 = 0.3090, p 2 = 0.3955 
x 3 = 1.000, p 3 = 0.1238 



9.524 x 10" 



0.000 



10 



xi = -0.9864, pi = 0.08071 
x 2 = -0.8795, p 2 = 0.09082 
x 3 = -0.6773, p 3 = 0.01099 
x 4 = -0.4017, p 4 = 0.1311 
x 5 = -0.08258, p 5 = 0.1410 
x 6 = 0.2455, p 6 = 0.1321 
x 7 = 0.5469, p 7 = 0.1108 
x 8 = 0.7891, p 8 = 0.09006 
x 9 = 0.9458, p 9 = 0.07706 
Xio = 1.000, pio = 0.03642 



9.463 x 10 -7 



0.000 



Table 5.6: Approximate Tchebycheff designs for weighted polynomial regres- 
sion with w{x) = (1 - x) (1 + x) 



m 


graph of 




appr. Tchebycheff design 


A min (M(p)) 


l-ef4(p) 






\ : 

\ 






xi = -0.8660, pi = 0.3137 






3 








x 2 = 0.000, p 2 = 0.3725 
x 3 = 0.8660, p 3 = 0.3137 


5.882 x 10" 2 


0.000 




















X! = -0.9877, pi = 0.07329 
















x 2 = -0.8910, p 2 = 0.08127 








t 








x 3 = -0.7071, p 3 = 0.09702 










A: 






x 4 = -0.4540, p 4 = 0.1169 






10 










x 5 = -0.1564, p 5 = 0.1315 


5.593 x 10 -7 


0.000 


.7— 








x 6 = 0.1564, p 6 = 0.1315 
x 7 = 0.4540, p 7 = 0.1169 
x 8 = 0.7071, p 8 = 0.09702 
x 9 = 0.8910, p 9 = 0.08127 
Xio = 0.9877, pio = 0.07329 
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6 Concluding Remarks 



In this thesis, we first indicate a new definition of approximate Tchebycheff 
functions. By using this definition, we propose a new algorithm for construct- 
ing the approximate Tchebycheff designs for weighted polynomial regression 
with general weight functions. After that, we verify that the approximate Tcheby- 
cheff designs are close to E-optimal designs by numerical examples. Namely, 
the proposed algorithm enables us to calculate E-optimal designs approximately 
for weighted polynomial regression with general weight functions. 

As future works, it is necessary to discuss the definition of approximate 
Tchebycheff functions more strictly. We must clarify how much gaps of the ab- 
solute values of local maximums and local minimums of approximate Tcheby- 
cheff functions are admitted. Moreover, we must discuss how the proposed 
algorithm has a wide application. We wish that the proposed algorithm is used 
to solve real problems of experimental designs. 
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A Appendix: Results of Numerical Examples 

A. 1 The Numerical Examples of Theorem 14.11 

Tables IAT14A.4I are the results of the numerical examples for Theorem l4.11 The 
first column contains the degrees m of regression. The second column contains 
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the graphs of Tchebycheff functions k(x). The third column contains the ex- 
perimental conditions Xi,x 2 ,...,x m and p±,p 2 ,...,p m of the E-optimal designs 



written as 



X\ X 2 ... X m 
Pi P2 ■■■ Pm 



The last column contains the minimum eigenvalues A m i n (M(/i)) of the Fisher 
information matrix. The computation is executed on the software Maple 15. 
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Table A.1: E-optimal designs for weighted polynomial regression with w[x) = 1 



m 



10 



graph of k(x) 



E-optimal design 



jci = -1.000, pi =0.2000 
x 2 = 0.000, p 2 = 0.6000 
x 3 = 1.000, p 3 = 0.2000 



JCi = -1.000, pi = 
x 2 = -0.9397, p 2 
x 3 = -0.7660, p 3 
x 4 = -0.5000, p 4 
x 5 = -0.1736, ps 
x 6 = 0.1736, p6 = 
x 7 = 0.5000, p 7 = 
x 8 = 0.7660, ps = 
x 9 = 0.9397, p 9 = 
Xio = 1.000, pio = 



0.04011 
= 0.08563 
= 0.1020 
= 0.1263 
= 0.1460 
0.1460 
0.1263 
0.1020 
0.08563 

0.04011 



A min (M(p)) 



4.000 x 10" 



1.671 x 10" 6 



Table A.2: E-optimal designs for weighted polynomial regression with w{x) 
l-x 



m graph of k{x) 



10 






E-optimal design 



jci = -1.000, pi =0.1238 
x 2 = -0.3090, p 2 = 0.3955 
x 3 = 0.8090, p 3 = 0.4807 



Xi = -1.000, pi = 
x 2 = -0.9458, p 2 
x 3 = -0.7891, p 3 
x 4 = -0.5469, p 4 
x 5 = -0.2455, p 5 
x 6 = 0.08258, p 6 
x 7 = 0.4017, p 7 = 
Xs = 0.6773, ps = 
x 9 = 0.8795, p 9 = 
xio = 0.9864, pio 



: 0.03642 
= 0.07706 
= 0.09006 
= 0.1108 
= 0.1321 
= 0.1410 
0.1311 
0.1099 
0.09082 
= 0.08071 



A min (M(p)) 



9.524 x 10 -2 



9.463 x 10" 7 
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Table A.3: E-optimal designs for weighted polynomial regression with w{x) 
1 + x 



m 



10 



graph of k(x) 





E-optimal design 



Xi = -0.8090, pi = 0.4807 
x 2 = 0.3090, p 2 = 0.3955 
x 3 = 1.000, p 3 = 0.1238 



xi = -0.9864, pi = 0.08071 
x 2 = -0.8795, p 2 = 0.09082 
x 3 = -0.6773, p 3 = 0.01099 
x 4 = -0.4017, p 4 = 0.1311 
x 5 = -0.08258, p 5 = 0.1410 
x 6 = 0.2455, p 6 = 0.1321 
x 7 = 0.5469, p 7 = 0.1108 
x 8 = 0.7891, p 8 = 0.09006 
x 9 = 0.9458, p 9 = 0.07706 
Xio = 1.000, pio = 0.03642 



A min (M(p)) 



9.524 x 10 -2 



9.463 x 10" 7 



Table A.4: E-optimal designs for weighted polynomial regression with w{x) 
(l-x)(l + x) 



10 



graph of k(x) 



E-optimal design 



Xi = -0.8660, pi = 0.3137 
x 2 = 0.000, p 2 = 0.3725 
x 3 = 0.8660, p 3 = 0.3137 



Xi = -0.9877, pi 
x 2 = -0.8910, p 2 
x 3 = -0.7071, p 3 
x 4 = -0.4540, p 4 
x 5 = -0.1564, p 5 
X6 = 0.1564, p 6 = 
x 7 = 0.4540, p 7 = 
x 8 = 0.7071, p 8 = 
x 9 = 0.8910, p 9 = 
Xio = 0.9877, pio 



= 0.07329 
= 0.08127 
= 0.09702 
= 0.1169 
= 0.1315 
0.1315 
0.1169 
0.09702 
0.08127 
= 0.07329 



A min (M(p)) 



5.882 x 10" 2 



5.593 x 10 -7 
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